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1 Turing Machine 


A Turing Machine (TM) is a primitive computing device which can compute 
anything that is computable. Its data structure is a string over a finite set of 
characters (alphabet). Its program (at a state) uses a read-write head (cursor) 
to read a character from its current position, write a character in the same 
position. After that the cursor may be shifted one position to left or right or 
may stay stationary on the string. The machine may enter a new state of the 
program. 

Mathematically a Turing machine M is specified by 4-tuple of data, M = 


(Q, x, ô, s). 
(a) Q is a finite set of states. 


(b) È is the finite alphabet of the strings. It includes two special symbols, ‘U’ 
(blank) and ‘>’ (left end-marker). 


(c) The program is represented by the function 
6: Q xu (QU {h, Y, N}) x {=>} 


where ‘h’ is halting state, ‘Y’ is accepting halt state, ‘N?’ is rejecting halt 
state; ‘<’, head moves left, ‘—’, head moves right, ‘—’, head is stationary. 


(d) s is the start state of the TM. 


Sometime people talk about two alphabets, an input alphabet (X) and a tape 
alphabet (T), where © CT. 

The program ô of the machine specifies its dynamics. ô(p, o) = (q, y, D): at 
the current state p, if M reads o at the current position of the head, it overwrites 
a by y (y may be same as ø), the head moves according to D € {4}, >, —} and 
the machine goes to a new state q (q may be same as p). 

There is a special requirement in 6 for the symbol ‘>’. 6(p,>) = (q, >, >), 
for all p € Q. This stops the machine to go beyond the leftmost end of the 


string. If the machine goes beyond the right end of the input, it sees a blank 
(U) and it may be overwritten and the string increases in length. 

Input to the machine is “Dx”, where x € (X \ {>,L})*. The start state is s 
and the initial head position is ‘>’. 

A configuration of a machine is (p,x,u), where the machine is in state p, the 
current position of the head is at the last symbol of x, u is the string to the 
right of the head (last symbol of u should not be ‘L’). 

We define a binary relation ‘— pm’ over the space of configurations of M. The 
TM M goes in one step from the configuration (p, x, u) to (q,y,v) and we write 
(p,x,u) >m (q,y,v) when 6(p,a) = (q,b, D). Let x = z'a, one of the following 
is the situation. 


If a = >œ, then b = > and D =>. 
If u = £, then y = zU and v = €, 
If u = cu’, then y = xc and v = wu’. 


If a 4 >œ and D =>. 
If u = £, then y = x'bU and v = €, 
If u = cu’, then y = x'bc and v = w’. 


e Ifa 4> and D=¢, 
then y = x’ and v = bu. 


e Ifa 4> and D=- , 
then y = x'b and v = u. 


If there are k + 1 > 1 configurations such that 


(p, x,u) = (po, £o, Uo) >m (P1, 21, U1) >M +++ mM (Pk, £k, Uk) = (q, Y, v), 


we say that starting from the configuration (p, x,u), the TM reaches the con- 
figuration (q, y, v) in k > 0 steps and denote it as 


(p, T, u)—>m* (q, y, v) or simply (p, T, u) >" (q, Y, v). 


The start configuration of the TM M = (Q,%,6,s) is (s, œ, x) where x € 
(£ \ {>œ,0})*. There are three possible halting configurations of our brand of 
machine: (h, u,v), (Y,u,v) and (N, u,v). But a TM may not halt at all. 

Let x € X \ {>,U}, x € L(M) if (s,>,£)>m* (Y, z1,u1), x ¢ L(M) if 
(s, >, x£)>m*(N, 21, u1). 

We also have to fix up a convention about the value of the function computed 
by M i.e. (s,>,£)>m*(h,x1,u'). We may have f(x) = M(x) = x'u', where 
zı =a’ and there is no blanks (U) at the end of wu’. 

Example 1. M = ({s},{0,1,>,U},6,s) is a very simple TM. The state 
transition table is as follows. 


It finds the 1’s complement of a binary string. 


Exercise 1. Design a TM that does not halt on any input. Let the input 
alphabet be {0, 1}. 

Exercise 2. Design a TM that takes input x € {0,1}«. It halts only after 
getting four 1’s. 

Exercise 3. What does the TM M = ({s, qo, qi}, {0, 1, >, U}, 6, s) compute on 
input >a, where x € {0,1}*? 


Fi 


> 
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> 
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Exercise 4. What does the TM M = ({s, q1, ¢2, q3}, {0, 1, >, LU}, 6, s) compute 
on input >, where x € {0,1}*? 


Exercise 5. Design a TM that takes the input >U* x, where k > 0, x € {0,1}+ 
and produces the output > Lt! y, 

Exercise 6. Design a TM that takes the input >x, where x € {0,1}* and 
produces the output by, where y = 2 x x. Interpret x as an unsigned binary 
numeral. 

Exercise 7. Design a TM that takes the input >a, where x € {0,1}*. It 
accepts x if x = 0”1”, n > 0. Otherwise it rejects x. 

Exercise 8. What is the estimate of the number of steps (state transitions) of 
the machine for an input 071"? 

The question is can we do it better. The answer is positive, but the TM will 
be slightly more complicated and instead of giving the precise description of the 
machine we provide the outline of the algorithm. But before that an example. 
Example 2. Input: >0000000011111111 


(a) We first check whether there is any 0 after 1. This will take O(n) steps. 


(b) Repeat the following steps as long as there is some 0 or 1 is left in the 
string. 


(i) Check whether the parity of 0 and 1 (together) is even. reject if odd. 
This also takes O(n) steps. 


(ii) Cross off alternate 0’s starting with the first one. Also cross off 
alternate 1’s starting with the first one. This reduces the number of 
0’s and 1’s to half in each step. 


>0000000011 
>POPOPOP071 
> APPoPPPorT 
>APPMPPHOKT 
>PPIM POO OK 


(c) If there is no 1 or 0 on the tape, accept, otherwise reject. 


So the number of steps are O(n) + O(nlogn) = O(nlogn). 

Can we do even better. The answer is negative on our single string TM. 
If the number of steps required to decide a language L on a single tape TM is 
o(nlogn), then L is a regular language. But our language L = {0"1" : n > 0} 
is known to be non-regular (context-free) language. So O(n logn) is the best on 
this model. 

Definition 1. Let the language L C (£ \ {U,>})*. If there is a TM M, 
that on input œx (x € (X \ {U,>})*) halts at state Y if x € L, and halts at 
state N if x ¢ L, then the language L is called Turing decidable or recursive 
language. 

A language L C (©\{U, &})* is Turing recognizable or recursively enumerable 
if there is a TM M that on input œ< halts at state Y if x € L, but either halts 
at state N or may not halt at all if x ¢ L. 

From the definition it is clear that the set of recursive languages is a subset 
of recursively enumerable languages. In fact it is a proper subset. The language 


Ly ={< M,d>: M is a Turing machine which halts on input d}. 


is recursively enumerable (Turing recognizable) but not recursive (not Turing 


decidable). 


2 Turing Machine with Multiple Tapes/Strings 


There are different variants of a Turing machine. In terms of absolute comput- 
ing power all these models are equivalent. But in terms of resource restricted 
computation their powers are different (at least it seems to be). 

Definition 2. A k-tape TM, M = (Q,5,4,s), k > 1, has k independent 
strings, each equipped with its independently movable read/write head. Actions 
of each head are controlled by the function (program) ô. 


6:Qx=* = (QU{h, Y, N}) x (© x {o,3,-})*. 


O(p,01,°++ , 0%) = (q, (11, D1), , (Yk, De)), where p is the current state, o1,- , Ok 
are input read from k tapes, q is the next state, y1,--- , Yk are symbols written 
on k tapes, and D,,--- , Dx are movements of head on k tapes. 

A configuration is a 2k+1-tuple: (p, 21, U1, *** , £k, Ux), where p is the current 
state, the i” string has x;u;. The it” head is at the rightmost symbol of 2;. 
The start configuration is (s,>,x,>,¢,--:,&,¢), the actual input is x on the 
first tape. Other tapes are empty except the left-end sentinel ’>’. 

An input x is accepted i.e. x E€ L(M), if 


(s, >, £, D,E, bee) >M (Y,21,U1,°°° , Tk, Uk). 
An input z is rejected i.e. x ¢ L(M) if 
(s, >, £, D,E, O52) >M (N, ita , Lk, Uk). 


For computation of a function we need to fix-up a convention where the output 
of M(x) will be. 

Exercise 9. Show that L = {0"1": n > 0} can be decided in O(n) steps by 
a 2-tape TM. 


3 Nondeterministic Turing Machine 


A Nondeterministic Turing machine (NTM) is a not so realistic model of com- 
putation. It is also equivalent to a TM in terms of the absolute power of compu- 
tation. But in terms of efficiency it appears to be exponentially more powerful. 
Unfortunately it is unknown whether this exponential speedup is intrinsic to 
this model or due to lack of understanding of the nature of nondeterminism. 
This gives rise to the famous question of P verses NP. 

An NTM N = (Q,»,A,s) has same three data Q,© and s. But A C 
(Q x X) x (QU {h, Y, N}) x Bx {4,,-}) ie. A is a relation. 

Given a pair of current state and input, the machine may have zero, one or 
more number of next state, output and cursor movement triples. A configura- 
tion of an NTM is similar to a configuration of a TM. But for a TM, from a 
given configuration there is at most one (TM may be incompletely specified) 
next configuration, and a computation of TM forms a finite or infinite (non- 
terminating) sequence of configurations. But in an NTM a computation forms 
a tree of configurations with the start configuration at the root. 

An input x € (X\{t,U})* is accepted by an NTM N if there exists a sequence 
of configurations starting from (s, >, x) reaches a configuration (Y, y, u). Other 
sequences starting from (s, >, x) may reach (N, z,v) or even may not halt. 

A language L C (X \ {b,U})* is decided by an NTM N, if for any x € 
(a \ {>,U})*, xz € L if and only if (s, >, x) >) (Y, y, u). 

This essentially says that if « € L, there is a sequence of nondeterministic 
choices that leads to an accept halt. But if « ¢ L, no sequence of choice can 
leads to accept halt. 
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